Skin cancer detection through attention guided dual autoencoder approach with extreme learning machine

Skin cancer is a lethal disease, and its early detection plays a pivotal role in preventing its spread to other body organs and tissues. Artificial Intelligence (AI)-based automated methods can play a significant role in its early detection. This study presents an AI-based novel approach, termed 'DualAutoELM' for the effective identification of various types of skin cancers. The proposed method leverages a network of autoencoders, comprising two distinct autoencoders: the spatial autoencoder and the FFT (Fast Fourier Transform)-autoencoder. The spatial-autoencoder specializes in learning spatial features within input lesion images whereas the FFT-autoencoder learns to capture textural and distinguishing frequency patterns within transformed input skin lesion images through the reconstruction process. The use of attention modules at various levels within the encoder part of these autoencoders significantly improves their discriminative feature learning capabilities. An Extreme Learning Machine (ELM) with a single layer of feedforward is trained to classify skin malignancies using the characteristics that were recovered from the bottleneck layers of these autoencoders. The 'HAM10000' and 'ISIC-2017' are two publicly available datasets used to thoroughly assess the suggested approach. The experimental findings demonstrate the accuracy and robustness of the proposed technique, with AUC, precision, and accuracy values for the 'HAM10000' dataset being 0.98, 97.68% and 97.66%, and for the 'ISIC-2017' dataset being 0.95, 86.75% and 86.68%, respectively. This study highlights the possibility of the suggested approach for accurate detection of skin cancer.

Traditional machine learning techniques have proven to be effective in categorising skin cancer 10 .However, these systems are prone to human error and subjected to the domain knowledge of human expert.Various feature extraction techniques have been utilized, including the Menzies approach 11 , the ABCD rule 12 , and the 7-point checklist 13 , for manual extraction of features.With the advancement in deep learning, networks such as autoencoders and convolutional neural networks (CNNs) have widely been used in many medical image recognition tasks [14][15][16] .These networks have been utilised for the tasks such as reconstruction, picture denoising, feature learning and object detection [17][18][19] .Despite the widespread use of deep learning-based methods, these methods suffer from the issues such as high computational cost, overfitting and the need for the large-annotated dataset 17 .The proposed method addresses the several key limitations of the conventional machine learning (ML)based method such as unlike ML-based methods which rely on manual feature extraction, the proposed method relies on automatic extraction of spatial and frequency domain features utilising the reconstruction process in autoencoders.Other advancements such as the use of attention layer in the proposed method specifically used to increase the discriminability of the extracted features, makes the proposed method more advanced in comparison to the traditional ML-based approaches.
The proposed work suggests a "dual-autoencoder" network specifically designed for distinguishing various patterns in skin lesion images.This network comprises of two specialised autoencoders, with one specifically trained to extract spatial information such as shapes and structural characteristics from the input images.Whereas the second autoencoder is specialised in capturing textural differences and the differences in frequency patterns found in different categories of skin cancers, resulting in understanding more comprehensive representations in the frequency domain.Post removal of the decoder component, the feature representations that these autoencoders have learned are taken out of the trained bottleneck layers of these autoencoders.An attention mechanism has been included in the autoencoder network to improve the efficacy of the learnt feature representation by the suggested technique.This mechanism prioritizes the learning of pertinent patterns while effectively filtering out noisy or irrelevant elements within the input lesion images.Additionally, an efficient classification component, employing a single-layer, feed-forward Extreme Learning Machine has been employed.This choice of classifier not only expedites the training but also upholds a high level of accuracy.Altogether, the proposed method offers a robust and innovative solution for skin lesion classification with high diagnostic performance.The contributions of the proposed work can be summarised as follows: 1.An innovative architecture termed 'DualAutoELM' has been proposed.This architecture can extract highly discriminative spatial and frequency domain patterns present in an input skin lesion image.2. The concept of multi-level attention has been integrated with the proposed method.3. High classification accuracy of 97.66% and 86.68% has been obtained for the HAM10000 and ISIC2017 datasets which proves the generalisability of the proposed method.
The rest of the paper can be read as follows: Section "Related works" details related works.Section "Dataset used" details about the used dataset.Section "Proposed method" provides a detailed explanation of the methodology used in this work.Section "Experimental results" presents the experimental results, and the final section concludes the proposed work.

Related works
In this section, a review of related works that are pertinent to the proposed research has been presented.Alenezi et al. 10 introduced a method utilizing a wavelet-transform-based pre-trained ResNet101 model as a feature extractor, coupled with an ELM, for the classification of skin lesion images, achieving a categorisation performance of 95.75% with the HAM10000 dataset.Yin et al. 15 innovatively combined unsupervised training of an autoencoder with supervised training of a classifier for autism detection, focusing on functional magnetic resonance imaging (fMRI) data.Cui et al. 20 proposed an autoencoder-based approach for Maize disease identification, leveraging encoded features to train the fully connected layers in their model.Qian et al. 8 introduced a method based on aggregating attention scores captured at different scales of skin lesion images using deep CNNs, incorporating class-specific loss weighting, and achieving a 91.6% classification accuracy with the HAM10000 dataset.Ding et al. 21presented a deep CNN with integrated attention mechanisms designed to generate class activation maps, enabling the network to focus on discriminative regions within input images, resulting in an AUC value of 0.922 with the ISIC2017 dataset.
In the domain of transfer learning, several notable works have made significant contributions to the field of skin cancer identification.Mendes and Krohling 22 presented a method that combines deep and handcrafted features with patient records for skin cancer prediction using images captured through a smartphone, known as PAD-UFES-20.Agarwal et al. 23 addressed the detection of face masks utilizing pre-trained deep CNNs in conjunction with a single-layer feed-forward ELM as a classifier.Toğaçar et al. 11 introduced an approach that amalgamates an autoencoder, MobileNetV2, and spiking neural networks for the categorisation of 1800 benign and 1497 malignant tumour images obtained from the ISIC dataset, achieving an impressive classification accuracy of 95.27%.Priyadharshini et al. 24 proposed a method for malignant skin lesion detection using Teaching-Learning-Based Optimization and an ELM, securing an F1-score of 91.64% in distinguishing benign from malignant skin lesions based on a dataset collected from Kaggle.In their research, Elaziz et al. 25 effectively identified key features by employing the Artificial Rabbits optimisation method along with the MobileNetV3 model for feature extraction.In fact, when testing their approach on the HAM10000 dataset, it yielded an impressive classification accuracy of 88.71%.
In the most recent research on skin cancer detection, Gomathi et al. 16 implemented cutting-edge techniques to achieve impressive results.By leveraging deep convolutional neural networks in tandem with the Bacterial

Pre-processing
The input images for the HAM10000 and ISIC2017 datasets were reshaped to have shapes of (28,28,3) and (64,64,3), respectively, as part of the pre-processing step.Since both datasets are imbalanced, therefore, the data imbalance has been removed by using random oversampling which randomly duplicates minority class samples www.nature.com/scientificreports/ in the training set with replacement.After oversampling images were normalised to bring the pixel values in the range 0-1.Other transformations such as one hot encoding, and data augmentation have also been performed.

Autoencoders
Autoencoders are a class of neural networks used in various fields, including computer vision and data compression 20 .They aim to learn a compact representation of input data by encoding it into a lower-dimensional latent space and subsequently decoding it to reconstruct the original input.This process is mathematically represented as follows: given an input vector x , the encoding function is defined using Eq.(1).
where W e and b e are the weight matrix and bias of the encoder respectively, and σ is an activation function.The decoder is defined using Eq. ( 2): where W d and b d are the weight matrix and bias of the decoder.Autoencoders are trained to minimize the reconstruction loss, typically using mean squared error (MSE) or binary cross-entropy loss, which is expressed a L(x, g(f (x)).
In this work, the concept of duality of autoencoders has been introduced which harnesses the reconstruction ability of autoencoders to learn skin lesion image representations from spatial and frequency domains.

Channel attention module
The block diagram of the channel attention mechanism (CAM) used in the proposed method is shown in Fig. 2. The use of the CAM in the proposed Dual-autoencoder network enables the autoencoders to focus on the most informative channels while paying less attention to the less informative channels.
The overall functionality of the CAM used in the proposed work can be defined using Eqs.(3-6).
x is the input feature map and x ∈ R HXWXC .H (height) x W (width) x C (number of channels).x i,j,c is the value at spatial position i, j in channel c. σ denotes the sigmoid activation function.⊙ represents element-wise multiplication.r,denotes compression ratio whose value has been set to 8, in this work.After GAP, a linear transformation is applied to the reduced tensor.The linear transformation consists of two convolutional layers.
The first convolutional layer reduces the number of channels to c r with a 1 × 1 kernel size.A ReLU (Rectified Linear Unit) activation function is then applied to introduce non-linearity.The second linear transformation consists of another 1 × 1 convolutional layer, his layer brings the tensor back to its original number of channels (C), and a sigmoid activation function is applied.Y 2 is the output after the second linear transformation, and it contains values between 0 and 1, indicating the importance of each channel.Finally, the channel attention is applied to the input feature map x by element-wise multiplication.This scales each channel by its importance score computed in the previous steps. (1)

Extreme learning machine
It is a fast supervised learning algorithm used for classification and regression tasks.It uses random initialisation of hidden layer weights and biases, distinguishing it from iterative optimization used in neural networks 10 .The hidden layer extracts features while the linear output layer learns the mapping to target values.The output of the i th hidden layer H i for the i th data point is computed using Eq. ( 7).
where σ is the sigmoid activation function.W h represents the randomly initialized weights for the hidden layer.b h is a bias term for the hidden layer.The output layer weights, denoted as β , are learned by solving a linear regression problem.The goal is to find β that minimizes the difference between the predicted values (hidden layer outputs) and the true target values.Thus, the linear regression problem can be formulated using Eq. ( 8).
where T is the target values (true labels) for the training data.H is the matrix of hidden layer outputs for all training samples.β is the output weight matrix that needs to be learned.To find β , the Moore-Penrose pseudo- inverse technique has been used.The pseudo-inverse of H, denoted as H + , can be calculated using Eq. ( 9).Then, the output weights β can be calculated using Eq. ( 10).
This calculation yields the output weights that minimize the error between the hidden layer outputs and the true target values.Once these output weights are learned, they remain fixed for making predictions.

Fast Fourier transform
The 2D Fast Fourier Transform (FFT2) is a mathematical operation used to transform an image, from the spatial to the frequency domain.It is a fundamental tool in signal processing and image analysis.Given an input array X with X ∈ R HXW ,representing a two-dimensional image array.Mathematically, the FFT2 operation can be represented using Eq. ( 11).
where, Y (u, v) represents the complex-valued frequency component at coordinates (u, v) in the frequency domain.X i, j is the value of the pixel at spatial coordinates (i, j) in the input array.H is the height of the input array.W is the width of the input array.u i and v j range from 0 to (H-1) and 0 to (W-1), respectively, representing the spatial frequencies in the horizontal and vertical directions.

Proposed dual auto-ELM method
The detailed architectural overview of the proposed method has been presented using Figs. 3 and 4. As presented in Fig. 3, the proposed method consists of a network of two distinct autoencoders responsible for learning the representations from input lesion images; these autoencoders are termed 'FFT-autoencoder' and 'spatialautoencoder' .Skin lesion images often exhibit subtle textural variations, which can be better represented in the frequency domain.FFT-autoencoder, specialized in re-constructing Fast Fourier Transform (FFT)-transformed frequency domain representation of skin lesion images, thereby, capturing intricate frequency patterns present within the skin lesion images.During training, the FFT-Autoencoder model learns to reconstruct, discern, and extract the most informative frequency characteristics, allowing it to distinguish fine-grained differences in lesion images.Concurrently, the spatial-autoencoder is designed to capture spatial features present in the input lesion images such as shape, borders, and overall structure present in an input skin lesion image.As shown in Fig. 3, the integration of CAM, in Spatial-autoencoder and FFT-autoencoder helps in effectively filtering out the noise and emphasizing the most salient spatial and frequency domain features.This duality of autoencoders helps in the extraction of fine-grained representation from skin lesion images and makes the proposed model robust against recognising the different skin conditions.
The loss function used in both autoencoders is the Mean Squared Error (MSE) loss.The MSE loss evaluates the difference between the original input and the reconstructed output, promoting accurate reconstruction.Mathematically, it is defined using Eq. ( 12).
where x is the original input, x is the reconstructed output and N is the number of input elements in x .As shown in Fig. 3, the SeLU activation function 39 has been used in place of ReLU within the convolutional layers of both autoencoders.The choice of SeLU activation is motivated by its self-normalizing properties, and its ability to mitigate the vanishing gradient problem, particularly results in better performance of the proposed model.The SeLU activation function can be mathematically expressed using Eq. ( 13).( 7) www.nature.com/scientificreports/where, x represents the input value.is a scale parameter and α is a negative slope, whose value is set to 1.0507 and 1.67326 respectively.Let X be the input feature map, W be the convolutional kernel weights, B be the bias, and H be the output feature map.The application of SeLU activation function can be expressed using Eq. ( 14).
where, * denotes the convolute and H is the output feature map with SeLU activations.

Feature extraction from dual-autoencoder network and classification using extreme learning machine
The feature extraction and classification process have been illustrated in Fig. 4.
(13) SeLU(x) = x, x > 0 α(e x − 1), x ≤ 0 After unsupervised training of the FFT-autoencoder and Spatial-autoencoder, the next step involves feature extraction.During this phase, the decoder sections of both autoencoders, responsible for reconstructing the input, are excluded, leaving only the encoder section.These encoder sections of both autoencoders have learned to capture high-level, abstract features from the spatial and frequency domain representations of input lesion images during unsupervised training.The layer from which features are extracted from an encoder part is referred to as the "bottleneck layer", which serves as a compact representation of the input data.The feature representations obtained from the bottleneck layer of the Spatial-encoder and FFT-encoder are denoted as F bottleneck spatial and F bottleneck FFT respectively, and these are combined to form a combined feature representation denoted as F bottleneck .F bottleneck retains valuable information about the underlying frequency domain patterns and spatial domain structures present within the skin lesion images, rendering it highly suitable for the skin cancer classification task at hand.
After feature extraction, the ELM classifier is employed for the subsequent classification.The combined feature representation F bottleneck serves as the input to the ELM classifier.ELM is trained to map these high-level features to the desired skin cancer class.Unlike traditional deep learning approaches that involve iterative optimization, ELM utilizes a fixed random projection in the hidden layer, resulting in significantly faster training.Mathematically, the feature extraction and classification process can be defined using Eqs.( 15)- (18).
where X is an input lesion image and y is the prediction made by the ELM.The hidden layers weights and biases of an ELM denoted as W h and B h , are randomly generated.W out and B out are the weights and biases from hidden layer to the output layer.The FFT function converts an input lesion image from spatial to the frequency domain and the abs() function calculates the magnitude of frequencies present in FFT-transformed lesion images.
In summary, our proposed dual-autoencoder-based network, incorporating a channel attention mechanism for channel-wise feature selection, and a SeLU activation for introducing non-linearity, utilizes the MSE loss for network optimization during training.The proposed architecture adaptively learns spatial and frequency domain features from an input skin lesion image.Subsequently, the combined representation obtained from bottleneck layers of the FFT-encoder and Spatial-encoder, is used for an efficient classification of skin lesion images using ELM.

Experimental results
Different experimental details and results related to the proposed work have been presented in this section as follows:

Experimental details
In this work, a novel approach for skin cancer categorisation based on a dual-autoencoder framework and an ELM has been proposed.All experiments were conducted on a computing platform equipped with an Nvidia P100 GPU, and 12 GB of RAM.The implementation of the proposed methodology is executed using the Keras (15) 2.14.0 library with the Python programming language.The assessment of the proposed method involves evaluation metrics, including precision, recall, F1-score, Area Under the Curve (AUC), and accuracy.
To evaluate the effectiveness of our proposed approach, two distinct publicly available datasets, namely ISIC-2017 and HAM10000 have been used.The ISIC-2017 dataset was composed of 2637 images in the training set and 660 images in the test set.It encompasses 1440 skin lesion images in the benign class and 1197 skin lesion images in the malignant class.Conversely, the HAM10000 dataset encompasses 10,015 dermoscopic images.The datasets employed in this study exhibit class imbalances.To address this issue, a data augmentation technique has been used to alleviate the disparities in class distribution.The shape of the input image in the case of the ISIC-2017 dataset and the HAM10000 dataset was re-shaped to (64, 64, 3) and (28, 28, 3) respectively.To ensure a robust evaluation, a split ratio of 0.8:0.2 has been used.Post-data augmentation, 80% of the data was allocated to train the model, remaining 20% of the data was used to test the model.

Data augmentation
Augmentation techniques including rotation (up to 20°), horizontal and vertical shifts (10%), horizontal flipping, and zooming (10%) have been used to enhance the ability of the proposed model to recognize skin lesions from different angles, locations, and scales.

Hyperparameters
The 'MSE' loss function, the ' Adam' optimizer, and a batch size of 128 were used to train the autoencoders.The 'sigmoid' activation function was applied to the hidden layer of the Extreme Learning Machine (ELM) classifier with 64 neurons.'Softmax' activation is used by the output layer of ELM classifier.From the training data, a validation set comprising 20% of the sample was chosen for model assessment.According to Alenezi et al. ( 2023), the hidden layer weights were initialised with random values and the output layer weights were computed using the Moore-Penrose Matrix Inverse function in ELM 10 .

Results
The experimental results obtained from testing the recommended approaches on the ISIC-2017 and HAM10000 datasets are presented in this section.After the FFT-autoencoder and Spatial-autoencoder were trained, features were taken out of the "Maxpool2" layer of both the autoencoders.The Extreme Learning Machine (ELM) classifier is trained using this unified feature set, which is created by combining the extracted features.Because the suggested dual-autoencoder network's input picture shape varies for each of the two datasets, there will be differences in the output shapes at every layer of the two autoencoders.Table 1 displays the output form and number of parameters at each autoencoder layer for the HAM10000 and ISIC-2017 datasets.The bottleneck layer has been highlighted in bold in Table 1.
As depicted in Table 2, the shape of the unified feature set given as an input to the ELM classifier for the HAM10000 and ISIC-2017 is (1,1568) and (1,8192), respectively.The corresponding details regarding the output shape and the number of parameters for the ELM classifier, configured with 64 hidden neurons, are presented in Table 2.
Training and validation accuracy/loss curves for the ELM classifier for HAM10000 and ISIC-2017 datasets, have been displayed as Fig. 5a,b, respectively.
An examination of Fig. 5a,b reveals that no signs of overfitting or underfitting are present.This observation underscores the fact that when employing the combined feature set to train the proposed ELM classifier, an optimal fit is achieved.
Figure 6a,b display the confusion matrices generated for both the HAM10000 and ISIC-2017 datasets.For the HAM10000 dataset, the ELM classifier exhibits remarkable classification performance with 100% accuracy www.nature.com/scientificreports/achieved for the 'akiec, ' 'bcc, ' ' df, ' and 'nv' classes.For ISIC-2017 dataset, the ELM classifier demonstrates superior performance in classifying 'benign' class samples compared to 'melanoma' class samples.Overall, the suggested method achieves an impressive average classification accuracy of 97.66% for the HAM10000 dataset and 86.68% for the ISIC-2017 dataset.
Performance assessment metrics such as precision, recall, and f1-score, are presented for each class, corresponding to the HAM10000 and ISIC-2017 datasets, have been presented in Tables 3 and 4 respectively.
The average precision, recall, f1-score and AUC value of 0.98 were achieved for the HAM10000 dataset.For, ISIC-2017 dataset, the average precision, recall, and f1-score of 0.87, with an average AUC value of 0.95 has been obtained.ROC-AUC curves for each class present in both datasets have been shown in Fig. 7.

Ablation study
An ablation study has been conducted to analyse the impact of different components of the DualAutoELM method on its performance.The use of ELM in place of multi-layer perceptron (MLP) has been rationalising by observing the performance of the proposed method by replacing the ELM with two layers of MLP consisting of two hidden layers with 64 and 128 neurons and this model is termed DualAutoMLP.The comparative analysis of the proposed 'DualAutoELM' method and the 'Dual-AutoMLP' method, with and without augmentation, has been presented in Table 5.
Analysing the data presented in Table 5 justifies the use of ELM and data augmentation in the methodology proposed in this work.To justify the use of Dual-autoencoder-based architecture the performance of the ELM  www.nature.com/scientificreports/classifier with the features extracted from the different components of the Dual-autoencoder has been analysed and presented in Table 6.It can be observed from Table 6 that the suggested method has outperformed when the combined features have been used to train the ELM classifier.To justify the use of the SeLU activation function, the ReLU activation function has been replaced with the SeLU activation function in the proposed DualAutoELM and the corresponding performance of the DualAutoELM method has been reported in Table 7.
As presented in Table 7, the performance of the proposed framework with the SeLU activation function has been justified over the use of the ReLU activation function.
Thus, this ablation study justifies the use of different components in the proposed framework.The next section makes a visual analysis of the proposed model to improve its interpretability.

Visualization
With the help of visualisation, the working of the DualAutoELM method has been analysed.To represent the discriminability of the high-dimensional features extracted from the bottleneck layer t-SNE plot has been plotted to represent high-dimensional features in two-dimensional space as shown in Fig. 8.The reconstructed images with the spatial-autoencoder have been analysed to understand the quality of representation of input images in latent space.Figure 9 shows the input image and the image reconstructed by the spatial autoencoder.It can be analysed from Fig. 9 that the quality of re-constructed images is not of high quality though the autoencoder has been successful in capturing the spatial properties of an input lesion image.
To visualise the region of focus of attention layers used in the autoencoder, heat maps obtained from individual attention layer has been visualised as shown in Fig. 10.
It can be analysed from Fig. 10 that the channel attention layers used in the proposed dual-autoencoder network focus on the region where the lesion is found to be present.The performance of the DualAutoELM method has also been compared with the other state-of-the-art method proposed by the other researchers for skin lesion classification, in recent years.

Comparison with other related works
The comparison of the experimental results obtained with the DualAutoELM method with other related works has also been made as presented in Table 8.     8 that the proposed method outperformed the other recent related works on several performance metrics.Therefore, the proposed method stands out due to its robustness and high classification performance for skin cancer classification tasks.

Conclusion
This work proposes a dual-autoencoder-based approach for learning the feature representation for multiple types of skin cancer identification and utilises extreme learning machines for classifying them into relevant categories.The capability of the DualAutoELM method to learn feature representation from spatial and frequency domain automatically makes it interesting and ELM plays a significant role in decreasing the computational complexity of the proposed method.The proposed method outperformed other works when tested with the HAM10000 and ISIC-2017 datasets.It has achieved classification accuracy of 97.66% and 86.68% with the HAM10000 and ISIC-2017 dataset respectively which makes it robust and efficient in identifying multiple types of skin cancers using the proposed method.
Despite the high classification performance of the proposed method certain limitations still need to be acknowledged.Though the proposed method has been tested on two diverse datasets, i.e., HAM10000 and ISIC2017, still it would be not sufficiently comprehensive testing strategy considering the variability among the skin lesion images captured in real-world clinical settings.Therefore, clinical validation of the proposed method in real-world setting needs to be performed.Additionally, the proposed model does not consider the integration of patient metadata such as age, sex and medical history which can significantly improve the performance of the proposed model.The future direction of the proposed research may be as follows: 1. Diversity of the dataset will be increased by including the skin lesion images captured in real-world clinical setting, so that generalizability and the robustness of the model can be evaluated in a more comprehensive manner.2. Important patient's meta-data such as age, sex and medical history will be integrated with the proposed model for accurate predictability of the skin cancer.3. A mobile application will be interfaced with the trained DualAutoELM model.www.nature.com/scientificreports/By addressing these limitations and exploring the possibilities in future direction of the present work, the potential of the proposed method in significantly impacting the early detection of and diagnosis of skin cancer can be further realized.

Figure 5 .
Figure 5. Training and Validation accuracy and loss curves for (a) the HAM10000 dataset and (b) the ISIC-2017 dataset.

Table 1 .
Output shape and number of parameters for Spatial-autoencoder and FFT-autoencoders for HAM10000 and ISIC-2017 dataset.

Table 2 .
Output shape and number of parameters for ELM for HAM10000 and ISIC-2017 dataset.

Table 3 .
Value of different performance metrics for the HAM10000 dataset.

Table 4 .
Value of different performance metrics for the ISIC-2017 dataset.

Table 5 .
Comparison of %Accuracy obtained by DualAutoELM and DualAutoMLP model with or without data augmentation.

Table 6 .
Performance of ELM classifier with the features extracted from spatial-encoder, FFT-encoder and dual-autoencoder for HAM10000 and ISIC-2017 dataset.

Table 7 .
Performance comparison with different activation functions for the proposed DualAutoELM model.

Table 8 .
Comparison with other related works.to segment the skin lesion image and the features were extracted from the segmented images using hybrid optimisation algorithm by combining Bacterial Foraging Optimization (BFO) and Particle Swarm Optimization for classification with the deep CNN Dual autoencoder networks have been used one for the extraction of the spatial features and other for the extraction of frequency domain features; the multi-level attention has been integrated in the encoder part; the combined features were classified using Extreme Learning Machine Vol:.(1234567890) Scientific Reports | (2024) 14:17785 | https://doi.org/10.1038/s41598-024-68749-1